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(54) Iniage processing apparatus with image region determining function 



(57) An image processing apparatus includes an 
edge processing section (1), an region data producing 
section {2, 3 4), and a region determining section (5). 
The edge processing section (1) enhances an edge por- 
tion of a first region of an image in units of picture ele- 
ments to produce an enhanced image. The Image 
includes the first region and a second region which are 
mixed, and picture elements of the image are expressed 
to as RGB data. The region data produdng section (2, 



3, 4) divides the enhanced image into regions to output 
region data indicative of each of the regions, variance 
data of each of the regions and contour edge data indic- 
ative of a contour of each of the regions. The region 
determining section (5) determines the first region in the 
enhanced image based on the region data, the variance 
data and the contour edge data. 
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Description 

Background of the Invention 

5 1. Field of the Invention 

fSn. ^^^^ '^3"'" <teterminlng apparatus with an image region determining 

2. Descriptio n of the Ralatgrl /^ it 

!^L.h ^ "^""^""^ P"""^"^ '"^ "P^^^*^ ^^'^ ""a9« processing apparatus in these days 

^^a m Jhod Of compressing suci, digital image data, a DCT coding method such as the Jp'eg method is iide^f^d 

15 [0003] In accordance with the atwve-mentioned DCT coding method, an Image Is resolved based on the f reauencv 

rrellThfDCT ' 'TI: r '"'"^'^ ^^"^^ ^^^^^^^ -"9%. and data compr^s on iZn^S 
whU^hltlT . ? ."^ ^^^"^ '^"^ °" •'P»""°' «°'"Pres6ing method to a natural image in 

which the picture element values change continuously. ^ 

^" ""^^^ characters and illustrations or drawings in addition to the nat- 

n^lml imLTT H ' "'^^ ^^"''"3 ""j^)- "^^ '^''^^•^ ^"'^ drawings are superposed on t!e 

Thl """^ ? ^"^ ^ ^ degradation of Image quality Is caused to a largeSnt 

steer^X^!', .1 '!f °' '^"^"""^ ^'''^P""^"* ^^^"S^*' °* ''"i^ ^1 "een reduced so th« t!e 

Si aX^^^^^^ '''T''', °' '^"^ ^9'°"^ ^^^''^ ^ the drawings 

1!^!^ ^- , !. ""^ ^ P^""*'"' « '"^hod is known in which the quantization step of the DCT 
coefficient .s controlled. In this technique, the blocl. which contains the contour porfion of the cSSrtli or dmw^ 
Wn can be coded in a high precision, so that a coding warp in the contour portion impro^d ' 
En • f ""^""^'"9 ^^«P « "'"t'^'te^^. when the character region and the 

,he3o,T ' °' """9^' '''^^^ ^ P™'"^'" th^t « increases Sbb^S^e 

hemost of the blocks are coded in the high precision to attain an enough image quality. 

^niH'n "'"r ^T' ^ ^'^'^^'^ ^«9»"= °' the character region and the nat- 

ural image region, and each region Is compressed by the different coding method. In accordance with this method an 

sutiroCT^Td a°:r iLt^r" i^Tr^^^ 

sucn mat ucr and a wave let are used for the natu ral image region is used 

[0008] In the above method, because each divided region (the character region and the natural imace realon) can 
imorrr : T:"" °' ^'^^^ ^""""'^ ^" ^^^^ characteristte fbrlvery region.rX quaS^ clle 
ZZ tT"' ''''^ independently used. Also, the Increase of the ^de quan% 

can be held even when the rate of the character region is increased. However, there is a problem of limiSttons S 

ir!? ' , !k conventional example for solving the above-mentioned problem, a conventional image processina 
te'r'rer„%:H T ^^'^^'"'"S '""ction is shown in Fig. 1. Inthe conventionaidetemiining procTss of t'hTS^^ 

RGB^Zr.^T^ °^ '"-^S^ °' ^'"^ ~ript is converged Sto 

chalL« ^ '^^^ data represented by 3 primary colors of R (red). G (green) and B (the blue). A detemiination of Se 
f^i^ T" °"'*^'^«.P''.°t'>9«Ph region in the input image fe carried out using the converted RGbZ 
[MID] The rnanuscnpt is generally read by a CCD device or a scanner in the fomi of RGB data and then each of 

deterredr^me?Jr^^^^^ 

determined using the 8-brt data. Such a technique is known. Hereinafter, th^ 

[0011] Refening to Rg. 1 . the conventional image region detennining apparatus is mainly comoosed of a color 

Sorirrf'"''''^°"'°^-'~"^*^"^«''°^^^^^ 

Sed in rbte'rciJZS!!'?^^^ 1^'°" "PP^'^'"^' ^'t''^ RGB data of the input image fe 

ess IS earned out therein to reduce 1 to 3 bits of the data. As this color reducing process there is a method of simnL 

lowerSbits Of each 8-brtdataof the RGB dataare Simply cut off. each Of the RGB databecomes3-brSt 
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the number of reduced colors is 512 {= 23 x 23 x 23 ). The region clustering process is carried out to these 512 colors, 
and the region determination is sufficient to be carried out for every clustered region. 

[00131 In the constant color region clustering section 1 02» an optional concerned picture element is compared with 
eight picture elements which are neighbor to the concerned picture element, as shown in Fig. 2 using the color reduced 

5 data obtained through the cutting off or rounding of the lower bits by the color reducing and quantizing section 101 . 
When it is determined to be the same quantization value based on the comparing result, an integrating process is car- 
ried out as a constant color region. For example, as shown in Fig. 2. the concerned picture element is a concerned pic- 
ture element R It is supposed that eight picture elements as the peripheral picture elements which sun-ound the 
concerned picture element P are a picture element P1 to a picture element P8. The picture element value of the con- 

w cerned picture element P is compared with the picture element value of each of picture elements PI to PB In order to 
integrate the picture elements with respect to the same quantization value. Thus, the clustering process Is carried out 
as the same color region. 

[001 41 In this case, in the constant color region clustering section 1 02, a region after the clustering process is com- 
posed of one constant color region or several constant color regions in the character regions and the drawing regions 

75 in which color variation is regarded to be less in the color manuscript. The characteristic quantity is found for every 
region to which the clustering process is carried out so that a region detemnination is carried out. In the conventional 
example, the color deviation is detected for every region in the region to which the clustering process is canied out in 
the color deviation variance detecting section 103. The edge portion or boundary portion of the character region in the 
window is detected by the edge-in-window detecting section 104. The determination of the character region or the pho- 

20 tograph region is canried out in the region determining section 1 05 using the detection data. 

[001 5] In the detecting process in the color deviation variance detecting section 1 03, it is supposed that the region 
composed of a plurality of picture elements and integrated to have the same quantization value by the constant color 
region clustering section 102 is a constant color region A. In this case, the color deviation in the constant color region 
A is calculated using the following equation (1) shown below: 

V(A) = (1/N(A)) X i:(Dif(C(P), C(Aav. ))): n(p€ A) (1 ) 

where in the above-mentioned equation (1), V(A) is the variance in the color region A (deviation degree of color), N(A) 
is the number of picture elements in the color region A, C(P) is each 8-bit data value of RGB data in the optional con-. 
30 cerned picture element P. C(Aav.) is an average 8-bit data value of the RGB data in the color region A. 

[0016] The difference between the average C(Aav.) of the RGB data in the constant color region A and the 8-bit 
data value C(P) of each of the RGB colors In the concerned picture element P is calculated based on the following 
equation (2). 

35 Dif(C{P). C(Aav.)) = {(R(P) - R(Aav.))^ +(G(P) - G(Aav.))^ + (B(P) - B(Aav.))^}^^ (2) 

[0017] In the above-mentioned equation (2), R(P). G(P), and B(P) represent the 8-bit data value of each of the R 
data, the G data, and the B data In the concerned picture element R Also, R{Aav.), G(Aav.), and B(Aav.) are averages 
of the RGB data in the constant color region A. In the color deviation variance detecting section 1 03, the color deviation 
40 V(A) in each constant color region A is calculated based on the above-mentioned equation (2). 

[0018] The detecting process in the edge-in-window detecting section 104 is carried out based on the following 
equation (3) to detect a steep edge around the contour portion of the input image. It should be noted that W shows the 
window shown in Fig. 2. 

45 H(A) = max{H{P)): |Pc A) - (3) 

H(P) = Dif(C(P),C(Wav)) 
[0019] In the above-mentioned equation (3). 

so 

H(A): The maximum of the high frequency component strength in the color region A. and- 
H(P): the high frequency component strength at concerned picture element R 

[0020] The high frequency component strength H(P) at the concerned picture element P is represented by use of 
55 the average of the RGB data in window of (3x3) with 9 picture elements shown in Fig. 2 and the average square dis- 
tance at the concerned picture elennent P. 

[0021 ] The region determining section 1 05 cames out the detennination of the character and drawing region or the 
photograph region in the clustered constant color region A, based on V(A) outputted from the color deviation variance 
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the'Sep eSh~^^^^^^^ '^'^^ ^-ing region and «,e existence of 

ance (the color devlatton) In i^^Xr^on AZmTZ^^^^ ^^'^^ ■ 

maximum Of the high frequency cor^poJenllnS^^^^^^^^ 

based on the following condition. ^ ^ '^9'°" determination Is carried out 

[0023] The character and drawing region: 

V(A) < VT1 and H(A) > HTl 

[0024J The photograph region: 
except the above condition 

tEoldi^T^TgttL^^^^^ : """^ '^"^'"^ monochromatfcfty the re^on. HT, is a 

in accordance vlrSrorcJnd^nT^^^^^^ ^^^"^^ 4onCndary 

-teep edge IS determlnedto be^cha^Tfr^^^^ 

100261 MrtwAWAf tkA «u« ^ 
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K Arjrp;t;::;°?::rge;^^^^^ 

in the photograph portion, it pHllTsuc^s J^.f^f " tt"*^'' '""""^"P' P^^^ »° « "«tural color image 
scrip. whx:h contai^: charact^^ X a -dt^^^^^^^ However. «^en a manu- 

boundary portion between the character renion a nH .hL k f w ^^'^ ^ " Possible for the 

in whK^h the Characters is L'^onS;' reH^^^^^^^^ 

steep edge around the contour portion LVchflraSLv5,r22l?^^ " '"e 
LflSitthe'iS'ofZdrai^^^^^^^^^ 

region is separated into the l,nta X^^^ quantizing process. Therefor, the constant color 

Which read b T/'re^rg^^irH^;^ S^^^^^ d.iding process is carried out to the RGB data, 

sional data in the RGB color spacTis nrr^ cZr t kkT ^ ''"'^"'^ "^^'^ measurement of the S-dimen- 
the human engineering. ThSrTle Sa rp^Xp^^^^^^^ 
=m:g~^ 

Spatercriir™ 

binary values. A reducing section (4) reduces the JiT™ a ^ ^ '"^ monochromatfe image into 

of the region of components such « the bSarimZir^" t ^'^^ ^""^"^'"^ ^^'^^ ^ boundao^ 

determining section (6) deiSe" ptn^Srofa o^^^^^^ °* '"P"' A" ""^S^ "^'"^ 

processing apparatus L furtZ compSdTa ^'"^^^^^ """"^'V- 'mage 

effectK^ pattern determination. a'Tgran mag l^Z P-P««essing Is carried out for a'n 

tern. The -.age .nddetermlnationisL^^ 

ness determining section l U)STb^ ll^^^T ""'^^ "^^^ signal by a thick- 
detected by an edge dete«ing ^.Jio^^is)^^^^^^ ch r'T^"!"" ''^^ ^ character/line is 
thickness determlnafion s^Z^n^J, " ^ ^ d 16). A 
when image pr>cessing Zlle ZTi oT^J^ T^^T ° ^"'^^ continuously changed. 
t0032] Also, an image reZ sSm^^^^^^ Tr» T"T'^, ""'"^ data 
Heisei 8-237475). In mr^^ !^^^^!^^'^,^'^'' ''^^''^^ Open Patent Application (JP-A- 
a concerned picture elemrri^^p^TsesTeTurh ^^r^^^ °V" f ""^ ^"^"^ '^^'^^ '"-'"ding 
mum signal level difference detecSng^S (S3)Tn eS. 21^ ""^""^ ^'"9 P«««^ (SI), a max? 
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ried out based on the processing results. 

[0033] Also, an image reading apparatus is disclosed in Japanese Laid Open Patent Application (JP-A-Heisei 11- 
88705). In this reference, the image reading apparatus is composed of window setting means (14), edge quantity cal- 
culating means (18), filter selecting means (1 9), filter calculating and selecting means (20) of calculating an output can- 
5 didate value, and output value selecting means (24) for selecting an output candidate value. Because an optimal high- 
pass fitter is operated based on the edge quantity, an image of high quality can be outputted. In the image reading appa- 
ratus, the degradation of the image quality read out by the image reading apparatus such as a scanner can be pre- 
vented. 

[0034] Also, an image processing apparatus is disclosed in Japan Patent No. 2.672,553. In this reference, a tone 
10 process is canied out to an image data with respect to a plurality of color components of an image, and an image data 
is outputted with respect to the plurality of color components In the image processing apparatus. Rrst determining 
means determines in units of color components whether or not a region of the image is a net point region. Second 
determining means detemnines as a net point region the region of the plurality of other color components corresponding 
to a region of one color component determined by the first determining means. Tone process means carries out a tone 
15 process for the net point region to the region determined as the net point region by the second determining means. 
Also, third detemnining means determines whether a region is a character region or a photograph region for every color 
component. Second tone process means carries out a tone process for the character region to output image data. Third 
tone process means carries out a tone process for the photograph region to output image data. Selecting means 
selects one of the second tone process means and the thinJ tone process means based on the determining result of 
20 the third determining means to the regions other than the net point region detemnined by the second determining 
means. 

Summary of the Invention 

25 [0035] Therefore, an object of the present invention is to provide an image processing apparatus with an image 
region detemnining function. In which a middle color In the boundary portion between a character region and a photo- 
graph region can be corrected. 

[0036] Another object of the present invention is to provide an image processing apparatus with an image region 
detemnining function, in which the process load in a region detemnlnation stage can be mainly reduced. 
30 [0037] Still another object of the present invention is to provide an image processing apparatus with an image 
region detemnining function, in which the number of division regions can be diminished. 

[0038] Yet still another object of the present invention is to provide an image processing apparatus with an image 
region detemnining function, in which image quality can be improved by an image process and image degradation due 
to block warp in a data compressing process can be reduced. 

35 [0039] In order to achieve an aspect of the present invention, an image processing apparatus includes an edge 
processing section, a region data producing section, and a region determining section. The edge processing section 
enhances an edge portion of a first region of an image in units of picture elements to produce an enhanced image. The 
image Includes the first region and a second region which are mixed, and picture elements of the Image are expressed 
to as RGB data. The region data producing section divides the enhanced image into regions to output region data indic- 

40 ative of each of the regions, variance data of each of the regions and contour edge data indicative of a contour of each 
of the regions. The region detemilning section determines the first region in the enhanced image based on the region 
data, the variance data and the contour edge data. 

[0040] The edge processing section selectively sets a picture element value of each of picture elements of the 
image as a concerned picture element to that of one of neighbor picture elements of the picture element in units of pic- 

45 ture elements of the image, to produce the enhanced image. In this case, the edge processing section may carry out 
an enhancing process to set the picture element value of the concerned picture element to the picture element value of 
a first one of the neighbor picture elements when the concerned picture element has a middle color between the first 
neighbor picture element and a second one of the neighbor picture elements in a direction opposite:to a direction of the 
first neighbor picture element with respect to the concerned picture element. In this case, the edge processing section 

50 cames out the enhancing process to set the picture element value of the concerned picture element to the picture ele- 
ment value of the first neighbor picture element when the concerned picture element has the middle color, and when 
a first color difference between the concerned picture element and the first neighbor picture element is smaller than a 
second color difference between the concerned picture element and the second neighbor picture element. Also, the 
edge processing section carries out the enhancing process to set the picture element value of the concerned picture 

55 element to the picture element value of the second neighbor picture element, when the concerned picture element has 
the middle color, and when the first color difference is equal to or larger than the second color difference between the 
concerned picture element and the second neighbor picture element. In this case, the color difference between the first 
and second neighbor picture elements is the largest among the color differences in the other opposing directions. The 
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carry out the enhancing proce^ when a So a X^^!TT T^' "'^^ ^'"•^^'"9 

and second neighbor pteture ete^^nL^^^H h T ^'^"'^ ^^'^ ^'^'"^"te outside of the tir^ 

neighPorpi«ure%.eii:';roX^^^^^^^^ 
rLing^°;i::.TcoreCSrn«^^ 

image into density data and hue data The densSI^^^diln «mi h „ °' '''^ P'"""^ 
respect to the densfty data to output JJj^^^^^^^^^ TT^^.T^'^'' ''^"^^ ^^9'°"^ 

Of each Of the density regions and dens^lZr eSe Z^^^^ ' ''"'"^ ''^"^'^ ^^''^"^^ ^^'^ 

hue dividing section which divides Te enZSi SSL^-S, k ! ^ °' ^^^^ °' ^^"^'^ ^9'°'^^- The 
region data indicative of eJ^^LZeTj^s ^Z^"!^ ^'^^ T '^"^ ""^ ^'^^ '"^^ 
data indicative ofacontour Of eacho he r^^^^ 



[0042] 

;5 



a densrty edge continuity confLIng sSor^^^ h^^^^ w "'"'"^ ^^'S^-'^'Window detecting section and 

The constant density cLerirZon rde^^hfSo ^ ""^'""'"^ <^«"««y ^^t^- 

data to output the density 2 eS h h T '•'"^^^ """"''^ ^^9'°"^ ^''^ '««P«* ^ density 

culates the density 2c?Z^ eac orJ^eTn^r^'^ ^^"'^^ "^'^"^ section which caT 

- c.ens-^edge-in-Idowd:iSs^ro„rfc^^^^^ 

« --.ah:^:;:rr:rs~ 
Sdrt^erc^:™^^^^ 

hue regions. The hue variance SSa sSil w2^«S f k '° ^ '"^^ 

detect hue uniformity of ea^uTrS^^T^ t'^^ "^''^""^ ''^^^ hue regions to 

30 in a window:. The hTedgf con«Xco2r!. na ff^-'^T'^ '"'"^'"^ ^«P"^ a" edge 

the detected steepness to'produt h^ ue Zol Se dl'2 iT":^ T""""^ °' ^''^e from the hue data and 
reduangand^^^^ 

E secrnVnd^^irS^S^^^^^^^ S'^on d^ ^ region deter- 
among the density regions based on^rr^rtTvlSce daS o^^^ '"'""^'"^^ '^'^"^ ''"^ ^«9'°"« 

contour edge data. The hue region dJ^e^l^sX wLh ^11 '""'"^ °' 

lance data of the variance data and hue ^Zur eS Z^^^^^^^^ 

the determined objective denslw reolo^s ST hS!.? o'^^e contour edge data. The integrating section integrates 
regions by the hue region ^^^!^^^^^^e2^^^ ^ ''"""""^^ 

first region Indication data and second region IndSon dS ole '"'"^'^""9 
ther include an- image pmcess region p^s" la sSLiL ^Ji^K J T ""^ '^3'°" «'etemilning section may fur- 
f i«t region indication data an^ r^L re^n ndiSSnTt ""M '^9'°" ^^'^ the 

ratus further includes an i^ge pr^rnrsSoT^lJ ^^""^ 'If "*"" "^^ '"'^S^ ^^^^'"9 ^PP^' 

indlcation data from the ima^ TcJo!^SSL2^^c'^TT """^^ "^^^'^ °" P"''"^^ ^l^"^"' -^Ston 
includeacodingprocess^ten^S^ZseSS'I^r • '"^^^ 
mcncationdatairun-rtsofbSoX c^^^^^^ 
further include a data compresslna section whirh rftmr<«! ' ^''^ "^^^ Processing apparatus m^ 

based on the block region Son dala ""'"P^^^^^ P'<'^essed Image from the Image processing section 

first region In the enhanced ima^e baiedl^i ,hf«2ton dL7« 1 °' '^^ ^^^ions: and by detemiining the 
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ment value of a first one of the neighbor picture elements when the concerned picture element has a middle color 
between the first neighbor picture element and a second one of the neighbor picture elements in a direction opposite to 
a direction of the first neighbor picture element with respect to the concerned picture element. 
[0047] In this case, the enhancing is attained by canying out the enhancing process to set the picture element value 

5 of the concerned picture element to the picture element value of the first neighbor picture element, when the concerned 
picture element has the middle color, and when a first color difference between the concerned picture element and the 
first neighbor picture element is smaller than a second color difference between the concerned picture element and the 
second neighbor picture element, and to set the picture element value of the concerned picture element to the picture 
element value of the second neighbor picture element, when the concerned picture element has the middle color, and 

10 when the first color difference is equal to or larger than the second color difference between the concerned picture ele- 
ment and the second neighbor picture element. In this case, the color difference between the first and second neighbor 
picture elements is the largest among the color differences in the other opposing directions. 

[0046] Also, the enhancing may be attained by carrying out the enhancing process, when a color difference 
between the first and second neighbor picture elements is equal to or larger than a first predetermined value. Also, the 

15 enhancing may be attained to carry out the enhancing process, when a ratio of a third color difference between picture 
elements outside of the first and second neighbor picture elements in the opposing directions to a tiiird color difference 
between the first and second neighbor picture elements is equal to or larger than a second predetermined value. 
[0049] Also, the dividing may be attained by converting the RGB data of each of the picture element of the 
enhanced image into density data and hue data; by carrying out a first clustering operation of the enhanced image into 

20 density regions with respect to the density data to output density region data indicative of each of the density regions, 
density variance data of each of the density regions and density contour edge data indicative of a contour of each of 
the density regions; and by carrying out a second clustering operation of the enhanced image into hue regions with 
respect to the hue data to output hue region data indicative of each of the hue regions, hue variance data of each of the 
hue regions and hue contour edge data indicative of a contour of each of the hue regions. 

25 [0050] In this case, the canying out a first clustering operation may be attained by quantizing the density data; by 
clustering the enhanced image into density regions with respect to the density data to output the density region data for 
each of the density regions; by calculating the density variance data of each of the density regions to detect density uni- 
formity of each density region; by detecting steepness of an edge in a window; and by confirming continuity of the edge 
from the density data and the detected steepness to produce the density contour edge data to output the density con: 

30 tour edge data. In this case, the quantizing desirably includes rounding lower bits of the density data for the quantiza- 
tion. 

[0051 ] Also, the carrying out a first clustering operation may be attained by quantizing the hue data; by dividing the 
enhanced image into hue regions with respect to the hue data to output the hue region data for each of the hue regions; 
by calculating the hue variance data of each of the hue regions to detect hue unifomriity of each hue region; by detecting 
35 Steepness of an edge in a window; and by confimning continuity of the edge from the hue data and the detected steep- 
ness to produce the hue contour edge data to output the hue contour edge data. In this case, the quantizing desirably 
includes: rounding lower bits of the hue data for the quantization. 

[0052] Also, the determining the first region may be attained by determining objective hue regions among the den- 
sity regions based on density variance data of the variance data and density contour edge data of the contour edge 
40 data; by determining objective density regions based on hue variance data of the variance data and hue contour edge 
data of the contour edge data; and integrating the detenmined objective density regions by the density region detemriin- 
ing section and the detennined objective hue regions by the hue region determining section to produce the first region. 
[0053] In this case, the integrating may include: adding first region indication data and second region indication data 
to the first region. In this case, when the determining the first region further include: outputting picture element region 
' 45 indication data from the first region indication data and second region indication data In units of picture elements, the 
image processing method may further include: processing the irnage based on the picture' element region indication 
data from the image process region processing section. 

[0054] Further, when the detennining the first region further include: processing the first region- indication data and 
second region indication data in units of block to output block region indication data, the image processing method fur- 
so ther include: compressing the processed image from the image processing section based on the block region indication 
data. 

[0055] in order to achieve still another aspect of the present invention, a recording medium In which a program is 
stored for any of the above image processing methods. 

55 
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Brief Description of the Drawings 
[0056] 
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Rg. 1 is a block diagram showing the structure of a conventional Image region detemiining apparatus- 
dl^raC ^""""^ " '''''' "'^'"'"^ ^'^^^^ °' convenZrS'color region 

rL'd;m:nr5,e ^^^^^^^^^^^ ^"^'-^^ °' '-^^ ^'^^ apparatus according to a nr. 

sioireiToisr^^^^^^^ 
s^^fpr^sSmi^ri^ir^'^"'^'^^^^ 

em'bol^entf t^^^^^^^^^^ """^^""^ °' monochroma«c region dMc«ng section according to the first 

St emh:rentf'th?p3XI^^^ "^"""^ °' '^^'^ ^^^'"^ -^'^ to the 

o?«,e%':ri:,;i"'''^"^'''^^~'^ 

Imen^SCretmfntlJor^''"^^^^ 9ion dividing section according ,o the first embod- 

onhlpiLmJvJlr''"^^ 

iSni;fCetTlnt2" 

g'Sund ?ortl2S;'"" ^ """'^ ^^'^'^ Po^- "-tween the character portion and the bacK- 

theVesent fZZ^"^"' ' '^'^'^^ °' wording to the first embodiment of 

right answer pememage ^^P' """"''^W Pe^<=entage to the character region 



35 



40 



45 



SO 



right answer percentage, 
Description of the Preferred Embodiments 
[0057] 



below in detail 2 rL:r:eZ:V::^^Z:^nZ^T:iS uS.r"' '"^T 

ratus, the image region determinina method ^^tZrJ^^^I?' "'^ ""^9® tletermlning appa- 

first embodimL Of the preI^;ZS ^'^""'"'"'"^ 

embodiment ofthepresentlnventlonfemai ;Tomp^^^^^ ^P-t- 'he first 

tion 2. a monochmmatic region dividing sectL 3. a hue re^LS^^nSA J;!:^^^ 

image process section 6. and a data compressing section 7 ' ^ detenm.n.ng section 5. an 

[0059] After a color manuscript of the three DrimarvcolQr<!Rr;Bie~.=wK., ^ ^ . • 

CCD is A/D^nverted. the A/D-converted data Is ir^nu^H .„ L ? *^ ^ '""^^ scanner and 

resentatlon. The picture e^er.enuZTJ^T,Z^^^^ °' '''S*^' ^^P' 

elements of the inputted color manuscriDtrc^.nS»rLd hrc!lr«, !ff ?^ ^ ''^"^ ^^"9 ^^^^ Pi«"'« 

element The p Jre elemem rue rt^e neS ^^^^^ 

the pknure element value oMhe pi^?^^^^^^^^^ 

KZ.eJS^"tX«^^^^^^^^^^ 
elementwhich is arranged in anyStheenZ^^^^^^^^ 

ing filter 1 to the pteture elememwhich is a^S^^ S,e S^r m r^"^ ^"^^ ^''S^ 

a concemed picture element Sfor^^E nS.- T ' T ^^'^^ P'^"^" "'^'"^"^ "ei9hbo,s 

poslngthatth'epfctureele^l^lSnerhrhefS^^^^^ 

thep.c.ree.ementva,ueo,.econcer.dpi.uree.rrr2reXr^^^^^^ 



8 



EP 1 079 599 A2 



ing filter 1 to the picture element which Is situated on the end portion of the input image, there are only five picture ele- 
ments which neighbors a concerned picture element. Therefore, the process is carried out, supposing that the picture 
element value of each of the three virtual picture elements has the same picture element value as the picture element 
value of the concerned picture element, as mentioned above. 

5 [0061 J As above-mentioned, the edge correcting filter 1 carries out a correcting process such that a portion having 
a steep edge in the contour portion of the image, especially, the contour portion between the character and drawing 
region and the baclcground region is emphasized or enhanced. Here, the emphasis or enhancement means the process 
of the picture element which is situated on the boundary portion of the character and drawing region in the contour por- 
tion and is recognized to have a middle color, and in which the picture element value of the picture element recognized 

10 as the middle color is inclined to (or is substituted with) either of the neighbor p'cture elements. 

[0062] Figs. 4A and 4B are diagrams showing an Input Image before and after the process by the above-mentioned 
edge correcting filter ^ . Fig. 4A shows the input image before the process by the edge correcting filter 1 . Fig. 4B shows 
a plurality of picture elements having middle colors in the contour portion of the Japanese Hirakana character "(D". The 
edge correcting filter 1 calculates color differences between each of the plurality of picture elements to be situated on 

15 the contour portion and eight neighbor picture elements using the RGB data. The correcting process is carried out such 
that the picture element value of the picture element is substituted with the picture element value of the neighbor picture 
element having the smallest color difference. The image as the result of such a correcting process is shown in Fig. 4B. 
[0063] In Fig. 48, the con-ecting process is can-led out such that the picture element value of each of the picture 
elements which are located in the. contour portion of the Japanese character "CO" before the correcting process and 

20 regarded to have middle colors is substituted with the picture element value of the neighbor picture element having the 
smallest color difference. Thus, the definite contour portion can be produced and the process in the foltowing state is 
can'ied out as the image having the steep edge in the contour portion. 

[0064] In the L'a*b* space converting section 2, the RGB data which has been corrected to emphasize the contour 
portion of the input image by the edge correcting filter 1 . that is, the edge con-ection data is converted into a color space 

25 data composed of brightness data L*. and hue data a* and b*. The brightness data L* is sent out to the monochromatic 
region dividing section 3, and the hue data a* and b* are sent out to the hue region dividing section 4. 
[0065] The monochromatic region dividing section 3 inputs the brightness data L* obtained through the conversion 
by the L*a*b* space converting section 2 and carries out a quantizing process of the brightness data and a clustering 
process. After the quantizing process and the clustering process are ended, constant density region data, variance data 

30 and contour edge data in the clustered regions are outputted to the region detennining section 5 to be mentioned later. 
[0066] The hue region dividing section 4 inputs the hue data a* and b* obtained through conversion by the L'a*b* 
space converting section 2 and cames out a quantizing process and a clustering process. After these processes are 
ended, constant hue region data, variance data and contour edge data in each clustered regional are outputted to the 
region determining section 5 to be mentioned later. 

35 [0067] The region determining section 5 inputs the constant density region data, the variance data and the contour 
edge data outputted from the above-mentioned monochromatic region dividing section 3 and the constant hue region 
data, the variance data and the contour edge data outputted from the hue region dividing section 4. Then, each of the 
Inputted data Is used as base data for the detenninatlon of the character and drawing region and the photograph region, 
and the region determination is carried out. 

40 [0068] The image process section 6 cames out an image process based on the region determination result which 
is outputted from the region determining section 5. 

[0069] The data compressing section 7 carries out appropriate data compressing processes which are different 
every region, based on the region determination result which is outputted from the region determining section 5 and the 
image data after the image process finish which is outputted from the image process section 6. 
45 [0070] Fig. 5 is a flow chart showing an operation example of the edge correcting filter 1 in the image region deter- 
mining apparatus according to the first embodiment of the present invention. In Fig. 5, when the RGB data of the input 
image is inputted (Step SI ), the picture elements which are recognized to have the middle colors in the contour portion 
of the input image is determined (Step S2). : 
[0071] At step S2, each of the picture elements which are determined to exist in the contour portion is set a con- 
so cerned picture element. Color differences between each concerned picture element and eight neighbor picture ele- 
ments are calculated (Step S3). 

[0072] At step S3, the calculated color differences to the eight picture elements is compared with a threshold value 
E which is given as the minimum color difference between the character region portion and the background region por- 
tion (Step S4). The concerned picture element associated with the color difference less than the threshold value E is 
55 determined not to be a picture element in the contour portion of the character region, and the process is stopped (Step 
S5). 

[0073] When the concerned picture element is determined to be the pteture element associated with the color dif- 
ference equal to or larger the threshold value E at the step S4, a first color difference between the neighbor picture ele- 
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Tts de the^^^^^^^^^^^ ^ ^""^ « ^"•^ "'"'^ t^^^^" the picture elements 

fe^c^ tS theX ^^^'omP^re^i. It is determined whether or not the ratio of the second color Stf- 

erence to the first color difference is equal to or smaller than a predetermined threshold value F2 (Step S6) 
[0074] When it is determined at the step S6 that the ratio of the color difference Is equal to or smaller than the ore- 
determined threshold value F2, the concerned picture element Is detemiined to be a pictur^ etelSte rnte JS^r 
Changing portion of the photograph region. Thus, the process is stopped (Step ST) ^ 
[0075J When it is determined at the step S6 that the ratio of the color difference is not equal to or smaller than th.. 
predetermined threshold value F2. the picture element value of the concerned pictui eleZVlI sutTi S t^e 
picture element value of the picture element which has the smaller color difference in asS^^flon wiSftSfcon^Trni^ 
picture element of the above-mentioned neighbor picture elements (Step S8) ^^^'^ *e concerned 

[0076] AS mentioned above, according to the edge correcting filter 1. the RGB data of the middle color existina in 
he contourportion of the input image is set to the RGBdata in either of the neighbor picture e^rjn^^^^ 
the process of removing a middle color is carried out. the number of the divided regions cL bTSceS llltTfeS 
has been conventionally increased because of the existence of the middle color. 

.iri .1" ° '^^^'^ '""^ ^"^"'^ °* monochromatic region dividing section 3 in the first 

embodiment of the present invention. In Rg. 6. the monochromatic region dividing section 3 is mainrc^mposed ofl 
densrty reducing and quantizing section 31 . a constant density region clustering section 32 a cZantTr^rlTon 

ston !oacervl?> 1^ ^"^ ' ""'""""^ '"""^ ^"^"^ L* obtained th«,ugh the corner 

s»nspaceby the L a b- space converting sectionaandcarri^^ 

date to the constant density region clustering section 32 to be mentioned later. Here, the rounding prieS ofthl lower 

r0079r -iV'""'.' "l?""*'^ °' ^'^^^^ ^ ^""'"3-°" °^ - half-adjusting process 

100791 The constant density region clustering section 32 carries out a dividing process of the densitv reaion h9«.rt 
on the density reduced data in which the lower bits are rounded by the density reduX^nd q!amS ^Sn sTJ 
should be notedthattherefeapossibility that the region is InsignlRcUtfMdedlS^^^^^^^ 

process IS earned out based on the density reduced data In which the lower bits are mundL tLX^ a dTst^^^^^^^ 

tt^irrrrsr^^^^^^^^ 
=hthe;:=s^^^^^^^^^^ 

!^T^ZZT'^ measurement result to the edge continuity confiSnation sUon i to be 

(0082J The edge continuity confinnation section 35 measures the existence quantity of the edae based on tho 

E,boa^SJolL"^?T =" «»"P» M Ihs m.„och™n«lc ^gio. dicing s«*,„ 3 h 0» 

wnicn nave been conected by the edge correcting filter 1 (Step S1 1 ) 

10084] The density reducing and quantizing section 31 cuts off the lower bits of the Inputted briahtness data i « to 

[00851 The constant densrty region clustering section 32 carries out a dividing or clusterina oracL to oon«t««t 
dens^ regions based on the density reduced data obtained through the mundlng p^^ Tih^o^r^Hre 
rounded by the density reducing and quantizing section 31 (Step S13) ^ 

Sn 5 an'Jthlti^^nTir^"''^^^ 

section 5 and the constant density region variance detecting section 33 (Step SI 4) 

Son J*'* «>"sta"t5e"s«y region variance detecting section 33 measures the uniformity of the densitv in the con 
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sent out from the edge-in-window detecting section 34. The measurement result is sent out to the region determining 
section 5 (Step SI 9). 

[0090] Fig. 8 is a block diagram showing the structure of the hue region dividing section 4 according to the first 
embodiment ot the present invention. In Rg. 8. the hue region dividing section 4 is mainly composed of a hue reducing 
and quantizing section 41. a constant hue region clustering section 42. a constant hue region variance detecting sec- 
tion 43. an edge-in-window detecting section 44. and an edge continuity confirmation section 45. 
[0091] The hue reducing and quantizing section 41 inputs the hue data a* and b* which are converted by the L'a'b* 
space converting section 2. The hue reducing and quantizing section 41 canies out the rounding process of the lower 
bits of each of the hue data a* and b'. The data that the lower bits are rounded is outputted to the constant hue region 
clustering 32 to be mentioned later as the hue reduced data. 

[0092] The constant hue region clustering section 42 can-ies out a dividing process of the hue region based on the 
hue reduced data in which the lower bits are rounded by the hue reducing and quantizing section 41 . It should be noted 
that there is a possibility that the region is divided into small regions, when a clustering process is carried out based on 
the data in which the lower bits are rounded, as in the al>ove-mentioned dividing process of the constant density region. 
Therefore, a distance between the neighbor picture elements is measured, and when the distance is near, an integrat- 
ing process is canried out such that the neighbor picture elements belong to the same region. 
[0093] The constant hue region variance detecting section 43 measures the unifomnity of the hue, i.e., the deviation 
of the color in the clustered region by the constant hue clustering section 42. 

[0094] The edge-in-window detecting section 44 inputs the hue data a* and b* which are converted by the L*a*b* 
space converting section 2. The edge-in-window detecting section 44 mainly measures the steepness of the contour 
edge between the neighbor regions. The detected steepness of the edge is sent out to the edge continuity confirmation 
section 45 to be mentioned later. 

[0095] The edge continuity confirmation section 45 measures the existence quantity of the edge based on the hue 
data a* and b* which are converted by the L*a*b* space converting section 2 and the detection result of the steepness 
of the edge which is sent out from the edge-in-window detecting section 44. 

[0096] Fig. 9 is a flow chart showing an operation example of the hue region dividing section 4 according to the first 
embodiment of the present invention. In Fig. 9. the hue data a* and b* are inputted to the hue reducing and quantizing 
section 41 among the data obtained through the conversion by the L*a*b* space converting section 2 to the RGB data 
in the contour portion which has been corrected by the edge correcting filter 1 (Step S21 ). 

[0097] The hue reducing and quantizing section 41 cuts off the lower bits of each of the hue data a' and b* and gen- 
erates and sends out the hue reduced data to the constant hue region clustering 42 (Step S22). 
[0098] The constant the hue region clustering section 42 candies out a clustering or dividing process into constant 
hue regions, based on the hue reduced data in which generated by rounding the lower bits by the hue reducing and 
quantizing section 41 (Step S23). 

[0099] The constant hue regions obtained through the dividing process at the step S23 are sent out to the region 
determining section 5 and the constant hue region variance detecting section 43 (Step 824). 
[0100] The uniformity of the hue in the constant hue region obtained by the clustering process is measured by the 
constant hue region variance detecting section 43 (Step S25). The measurement result Is sent out to the region deter- 
mining section 5 as the variance data (Step S26). 

[0101] The edge-in-window detecting section 44 inputs the hue data a* and b* which are outputted from the L*a*b* 
space converting section 2. The edge-in-window detecting section 44 mainly measures the steepness of the contour 
edge between the neighbor regions (Step S27). The measurement result is sent out to the edge continuity confinmation 
section 45 to be mentioned later as the edge detection data (Step S28). 

[0102] The edge continuity confirmation section 45 measures the existence quantity of the edge based on the hue 
data a* and b* which are outputted from the L*a*b* space converting section 2 and the edge detection data which is 
sent out from the edge-in-window detecting section 44. The measurement result is sent out to the region determining 

section 5 (Step S29). 

[0103] Fig. 10 is a block diagram showing the structure of the region determining section 5 according to the first 
embodiment of the present invention. In Rg. 10, the region determining section 5 is composed of a density character 
region determining section 51 , a hue character region detennining section 52. a density and hue region integrating sec- 
tion 53, a image process character and photograph region determining section 54 and a code character and photo- 
graph region determining section 55. 

[0104] In the region detennining section 5, the constant density region data, the variance data, and the edge detec- 
tion data are inputted from the monochromatic region dividing section 3. Also, the constant hue region data, the vari- 
ance data, and the edge detection data are inputted from the hue region dividing section 4. 
[0105] The density character region detennining section 51 candies out the determination of character and drawing 
region or photograph region with respect to the density data based on the constant density region variance data and 
the edge detection data. 
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detection data. ® '^'^ °" «>"stant hue region variance data and the edge 

s SpMotJ-ci'::^^^ 

region Which isdeter^ined^densitychfiJe^ eZ^^^^ 

ing section 52. The density and hue region inteqratlna secfion^^n.Zf \f ^ ^ hue character region determin- 
to the image quality character and photograSn c«4S s2fn ^ determination data 

region determining section 55 to be mentLed S "^'^""'"'"^ ^ ^ ^ode character and photograph 

«i-diin:ss^^^^^^ 

process in units of picture elements """"^ ^"^ ''"^ '^9'°" '"^«9'3""9 section 53 for an Image 

fSion^nteg^Cs™ 
« pression process and outputs the region deteZationl^ ^ ^'^^ ''^^ ^^'^^ 

irLen?sz:,rer.r^^^^^^^^ 

data are inputted from .he monochroLic ^gion SL/^^^^^^ variancedata. andthe edge detection 

data, and the edge detection data are inputted from he SeTl!^ 1^ '^9'°" ^^^ance 

a> [0111] The density character rpninTw!! ^ '"^*"9 * (Step S31). 

drawing region or thTpJotS J Sn r::iZrjdensrSr t 

detection data in the constant density regioMS^p sTa) °" ^"-^ 

fxied^a%^:rrcora^s^^^^^^^ 

determining section 52 (Step S33) ^9*°" ^"«"~<late and the edge detection data inthe hue character region 

fuV^gion:t:^;rn:rern?^^^^^^^^^^ 

graph region which isdetemiinedby eSh^fVhe deScte^^^ ! f^'^'^'' ^^9'°" "^^''^ P*^"^ 
region detemiining section 52. The adTeS date fe ol^^^^^^ 

determining section 54 and the code cha^ctefanV^^^^^^ 't'^n ? ''"'"^ ""^ P''°*°9^^ ^^S^n - 

(Step S34). ^'^^^^ ^""^ photograph region detemtiining section 55 to be mentioned later 

farieve^J^SreSr^^rnTe 

for an image pK«ess in units of pk:ture etemfnt^Te reoio?! Z "^^^^^ '""'^'^^ '^'^^ ^ 

35 tion 6 of the latter stage (Step S35). ^ deterniination data Is sent out to the Image process sec- 

KedeJJCiT^ro^'t^^^^^^ 

size necessary In case of the codingTand'Sj^^on p^^^^^ ? "^'^''^^ "'"^'^ ^^-^-^'O" 

pressing section 7 of the latter stage (StepS^) ^ ''^'^ " '° ^"^ 

fn^'lnwrteTrtTedTj^^^^^^^^^^ 

Of the RGB data Is 8-bit data after the colorlntX j^^^^^^ supposed that each of R data. Q data and B data 
is read and is A/D-converted. "manuscript in whwh the character region is present In the photograph ragion 

f^iofLlirC^^^SrTn;^^^^ 

portion and the background region PortSThe RG B^taZ?^^^^^ the character and drawing ragion 

A/D conversion, thera are a plurality of pic^re elementetS^rr^ ^ ^'f ' 

of picture elements which are recognize^trjaveTe midc^^^^^ ""'"^ W*^^" P'"'«'«y 

into very many regions through the region dSri^g p^^^^ "een dMded 

process is carried out for the region <l)^ZTmlS^,J^^7: . '^'"^^ring 
is provided for the plurafrty of picire eSs whto^fra ^^^^^^^^ 

ULiiit^Slt^oSt^^^^^^^^^^ 

element P has a middle color between neighbor pSura^eSLm pSd n jJ " 'y''^''' ''^ P'«"^ 
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ment PX3. Therefore, in such a case, the picture element value of the concerned picture element P is tilted to one hav- 
ing the smaller color difference of the picture element PX2 and the picture element PX3 by. in other words, one having 
the smaller color difference of the picture element PX2 and the picture element PX3 is substituted the picture element 
value of the concerned picture element P. At this time, when a ratio of the summation of the color differences to the color 
difference between the picture element PX2 and the picture element PX3 is smaller than a threshold value F1 , the con- 
cerned picture element Is detenmined not to be a picture element in the peripheral portion of the character region, and 
the above-mentioned edge correction process is not carried out. 

[0119] Moreover, it is supposed that the threshold value of the minimum color difference between the character and 
drawing region and the background region is E. There is a possibility that this filter process is carried out to a gentle 
color change portion which exists in the photograph region, when the process by the edge connecting filter 1 is carried 
out based on only this condition. Therefore, to see the gentle color change, a color difference between the picture ele- 
ments PX4 which are located outside the picture element PX2 and the picture element PX3 is compared with the color 
difference between picture element PX2 and picture element PX3. When the ratio is smaller than a threshold value F2, 
the region is detemnined to be a gentle color change portion in the photograph region. 

[01 20] Based on the above condition, supposing the four directions Xs which are shown in Fig. 1 3 to the concerned 
picture element P, i.e., a right diagonal directions 1 , a vertical direction 2, a left diagonal direction 3 and a horizontal 
direction 4, a color difference between the neighbor picture elements is calculated to all the directions (X=1-4) based 
on the following equation (4): 

Dif(C(P1).C(P2)) = {(R(P1)-R(P2))^ +{G(P1)-G(P2))^ +(B(P1 )-B(P2)) ^} (4) 

where each of R{P). G(P) and B(P) is 8-bit data of the RGB data of the concerned picture element P. 

Dif(C(PX2).C(P))+Dif(C(P).C(PX3))) /Dif(C(PX2).C(PX3)) s Fl 

and 

Dif(C(PX1 ).C(PX4))/Dif(C(PX2).C(PX3)) s F2 

Here; supposing that the direction in which Dif (C(PX2),C{PX3)) takes a maximum value is K in the direction X (X=1 -4), 
a color difference between the picture elements which are neighbor in the direction of K of the picture elements which 
are neighbor to the concerned picture element P is calculated, and the determination is carried out based on the follow- 
ing conditional expression. 
[0121] When Dif{C(PK2),C(PK3)) a E , 

C(P)=C{PK3) 

if Dlf(C(PK2),C(P)) & Dif(C(P),C(PK3)) , 

C(P) = C(PK2) 

if Dif(C(PK2),C(P)) < Dif(C(P),C(PK3)) 
[0122] As shown above, the RGB data in the contour portion of the input image is subjected to the correcting proc- 
ess by the edge correcting filter 1 , and is converted into the color space data which are shown by L*. a* and b* by the 
L*a*b* space converting section 2. ... 
[0123] In this case, the reason why the color space conversion is canied out by the L*a*b* color space converting 
section 2 is in that manipulation of data is relatively easy because the data is separated into the brightness (density) 
data and the hue data, and that the warp is very near the optic angle characteristic in a human engineering when data 
is rounded. 

[0124] In the first embodiment, the brightness data L* as the density component is treated by the monochromatic 
region dividing section 3 shown in Rg. 6. Alsa the hue data a* and b* are collectively treated by the hue region dividing 
section 4 shown in Rg. 8. 

[0125] It should be noted that the similar measuring processes are carried out in the monochromatic region dividing 
section 3 and the hue region dividing section 4 although the measurement of the1 -dimensional distance is canied out 
based on the brightness data L*, and measurement of the 2-dimensional distance of the hue data a* and b*. 
[0126] The definition of the distance in the picture element PI and the picture element P2: 
in Dif(C(Pl),C(P2)). 
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L component: 

Dif(L(P1),L(P2))=L(P1H(P2) 

a* and b* component: 



Dlf(ab(Pl),ab{P2)) = {(a*(P1).a*(P2))%(b*(Pl) -b*(P2))^] 
ro Ssed Ty 0^toT^{ '"^ ""^ - ^-Batea However, a distance . 

the lower bits of e^ of th^date of m T-7„h k- = k L '^'^'^'''"9 P'*^^' 'i'^' embodiment. 

Sim! I l^HPr'" ""^"^^ °' e'er^ent P is PX In this case 

2^ P anS S «? !" H ''"''^ " Dif(C(P).C(PX)) s FL . and 

P"3ij p and PX are in the constant hue regbn if Dif(C(P) C(PXn & Fab 

V(A) = 1/N(A)*I(DJf(C(P),C(A(Aav.)) : (Pe A) 
where in the above-mentioned equation, 
A: constant density region 

V(A) : variance in the constant density region A (density deviation) 
N(A): the number of picture elements in the constant density region A 

H(P) = MAX(Dif(C(P).C(PX))) : (Re W) 
Se^lmum'^reTs^ere^I^r^ 

element P. ^'^^ "'^'^ ^^"^'^ component strength of the concerned picture 
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H(A) = 1/N(A')rLH{P):(P€ A') 
[0137] In the above-mentioned equation, 
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H(A): the high frequency component strength in the constant density region A, and 
H(P): the high frequency component strength of the concerned picture element P 

[0138] The constant hue region variance detecting section 43 shown in Fig. 8 calculates the hue deviation in the 
5 constant hue region B based on the following equation. 

V(B) = l/N(B)*j:(Dif(C(P).C(B(Bav.)): (Pe B) 

[0139] In this case, in the above-mentioned equation, 

w 

' B: the constant hue region 

V(B) : the variance in the constant hue region B (the hue deviation) 
N(B); the number of picture elements in the constant hue region B 

C(P): the a* component value and the b* component value of the hue data of the concerned picture element P 
15 C(Aav.}: the average of the hue data a* and b* component values in the constant hue region B 

[0140] The edge-in-window detecting section 44 shown in Fig. 8 can-ies out an operation based on the following 
equation to detect a steep edge in the contour peripheral portion of the image. 

20 H(P) = MAX(Dif(C(P).C(PX)) (Pc W): 

where W shows the window of the 5x5 picture elements in which the concerned picture element P is centered as shown 
in Fig. 13. 

[0141] A distance between the picture element and the concerned picture element in the window is measured and 
2$ the maximum value is defined as H(P). H(P) indicates the high frequency component strength of picture element R 
[0142] Next, the edge continuity confimnation section 45 shown in Fig. 8 will be described. As the index indicating 
edge continuity, here, the hue component edge quantity in the constant hue region B is defined as follows. It is sup- 
posed that the set of the picture elements which face to the neighbor region in the constant hue region B is B*. Also, it 
is supposed that the number of picture elements of set B* is N(B'). 

30 

H(B) = 1/N(B')rEH(P) : (P € B') 

where H{B) shows high frequency component strength in the constant hue region B and H(P) shows the high frequency 
component strength of picture element R 

35 [0143] The input data to the region determining section 5 shown in Fig. 1 0 are the constant density region data, the 
variance data and the edge detection data from the monochromatic region dividing section 3. and the hue region data, 
the variance data and the edge detection data from the hue region dividing section 4. The integration of the region is 
carried out to the constant density region data and the constant hue region data by the density and hue region Integrat- 
ing section 53. In the density character region determining section 51 , the character region or photograph region is 

40 determined with respect to tine density data based on the variance data and the edge detection data In the constant 
density region A. In the hue character region detennining section 52, the detemiination of the character region or the 
photograph region is carried out with respect to the hue data based on the variance data and the edge detection data 
in constant hue region B. In this case, the single density, the monochromaticity and the existence of the steep edge in 
the contour peripheral portion as the characteristics of the character and drawing region are determined based on two 

45 parameters, i.e., the variance data and the edge data using the following condition with respect to each of the density 
and the hue. 

[0144] The density character and drawing region: 

V(A) < m and H(A) > HTL 

50 

[0145] The hue character and drawing region: 

V(A) < VTab and H(A) > HTab 

55 In this case, in the above-mentioned determination condition, 

VTL. VTab: threshold values indicating the single density, and the monochromaticity of the region 

IHTL, HTab: threshold values indicating the existence of tiie high frequency components in the region boundary 
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[0146] The above condition is to distinguish the character and drawing i^ion which has a steep edge with the sin- 

f bor/onrtI'lTc!^T'^''T'?'^ ^ "^S'""- «>« '«9to" satisfying the 

above condition is determined to be a photograph region. 

'"1"^ J!'^?^"f' ^ ^"'^ ^''^ '"^^^'^""g section 53 determines that the data distinguished as the character 
wi h respec^ to the densrty or the hue is contained in the character region, based on the character region detemiination 
data from the density character region detemiining section SI and the character region deteimination data from the hue 
character region detemiining section 52. Also, the detemilnation data of the character region or the photograph region 
IS added for every picture element, and the picture elements are outputted to the picture quality character and pfJto- 
graph region determining section 54 and code character and photograph region determining section 55. The picture 
qualrty character and photograph region determining section 54 produces the region detemiinatlon data corresponding 
to the picture element sequence to cany out an Image process In units of picture elements. The code chararter and 
TJ^^ , ^S-"" ^^If ^'"'"'"S section 55 processes to the region division data to match to the btod. com«rBion size 
necessary lor the band compressing process and outputs the region determination data. 

(Specific instance) 



ul'^L ir.. '"^"^^ ^"^^^ ^^'^'^ "Sing the image region determining appara- 

tus, the image region detemiining method and the recording medium in which the program is stored according to the 
embodiment of the present invention will be described. » 

thoIlL ^^f!^ '"^"^"^^ ^" ''""^ '^"^^'^ "Sing the image region detemiining apparatus 

the image region determining method and the recording medium In which the program Is stored accordlrj to the 
embodiment of the present invention will be described. In this example, five images that the red. green, blue, white and 
SSfr.S^n'^r ''T" *° "'^"'^ "^'^ ^'^^'^"^ '^st images. The effect of the image region 

tT^n ? TTT' kT^^® ^^'^"^'"'"9 the recording medium in which the program is stored 

according to the first embodiment of the present invention is confirmed using the test images 
ilmoL ?V°'^'""?.^'°^P''^^"'^^'^'"^"*softhetestimages:592140pictureelemente^ 
elements which are contained in the character region: 98561 picture elements 

EL n'L*'^ " ^^"P^^'^ ^^""^ •« composed of 12 to 32 picture elements in the size: The 

boundary porUon between the character region and the background region is approximated to the state in which the 

TnT? no^ '""^ ' '^''^ "^'"^ '''' "^'^^ -"^"^ «° some small extent in consWer- 

atlon to the noise of the input device. 

5? T^ere f^^I'T^T T^T^ '''^ P'^sent invention is shown In Rg. . 

14. There was a problem that the boundary region between the character and drawing region and the background 
region is divKled into a tot of regions in the conventional process because of the existence of the middle color Also 
there was a problem that a gently changing photograph region has been divided 

IZTr^m^ZTf' ^^°T^ T '"^^^ ''3'°" detemiining apparatus, the mage region detemiining method and 
therecordingmediuminwhichtheprogramisstoredaccordingtothefiiBtembodimentofthepresentinvention thedivi- 

itter and the region integrating process after the clustering process. Thus, the considerable improvement te seen 
no r!L JLhI *<smiination result by the image region detemiining apparatus, the Image rogion detemiln- 
ni^tf K ^"'^'^ =«=°^*"9 «^ embodiment of the present 

r r" T percentage in the character region at the horizontal axis and the ratio of the 

n thrn r^"'" ''T'"^'' "'S'"" P^'^^'^a^P^ '«9«" to the number of picture ele- 
ments in the character region in the verttoal axis. k c^^ic 

[01551 As shown in Rg. 15. in this evaluatfon.it is optimal that the non-right answer ratio becomes 0 when the char- 
acter region right answer percentage is 100%. Conventionally, the non-rght answer ratio becomes high as the right 

Shown tfauhe '' i ' "^"'^ ''^^ °" present invention. 72 

shown that the non-right answer ratio of the photograph region does not become high even if ^ 

age of the character region reaches 80%. h"'""'' 

t^I^h « ^^,7*'- *° P'^^®"* determination of the character region and the pho- 

tograph region of ttie image of the color manuscript that the character data and the photograph region are mixed «n 
ITS htk*'' '''' P-^'^'- Jhus. the improvement of quality in the image pr^ess'a^ the'^^ degmdaS! 
prntternrv^^e^Si:' "^''^'"^ "^^^ ^ ' ^ ^^^^^^ 

£??„H *e above-mentioned embodiments are only the embodiments of the present inven- 

rirrr^^iS^^^^^^^^^ 

[01S8I As seen from the above description, according to the image region detemiining apparatus, the image region 
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determining method and the recording medium in which the program is stored of the present invention, a middle color 
in the boundary portion between the character region and the photograph region is corrected by the edge correcting 
filter to the manuscript in which the color images are mixed. Therefore, the process load in the region detennination 
stage of the latter stage can be mainly reduced. 

5 [01 59] Especially, a connection is earned out to emphasize the contour portion in the portion which has a steep edge 
between the character region and the background region, and the number of division regions can be diminished. There- 
fore, in the image process of the manuscript which the character region and the photograph region are mixed, whch is 
the conventional problem, the region determination can be earned out in the high precision. Also, the image quality can 
be improved by the image process and the image degradation due to the block warp In the data compression can be 

10 reduced. 

[0160] The present Invention proposes the method in whteh the color manuscript in which a character region and a 
photograph region are mixed is read, and the color manuscript in which the character region and the photograph region 
are mixed is separated as the process at a stage before image process and a compression coding process of image 
data is carried out. As the method of separating the region as one feature of the present invention, an edge correcting 
15 filter is provided to carry out the process in whteh the picture element value of a picture element whteh is recognized to 
have a middle color of RGB data in the contour portion of the input image is substituted with a picture element value of 
either of the neighbor picture elements. In this way, the corrected RGB data is converted into color space data shown 
as L*, a*, and b*, and a region clustering process is carried out using the data attribute of each of the brightness data 
L* and the hue data a* and b*. 

20 

Claims 

1. An image processing apparatus comprising: 

25 an edge processing section which enhances an edge portion of a first region of an image in units of picture ele- 

ments to produce an enhanced image, wherein said image includes said first region and a second region which 
are mixed, and picture elements of said image are expressed to as RGB data; 

a region data producing section which divides said enhanced image into regions to output region data indica- 
tive of each of said regions, variance data of each of said regions and contour edge data indicative of a contour. 
30 of each of said regions; and 

a region determining section which determines said first region in said enhanced image based on said region 
data, said variance data and said contour edge data. 

2. The image processing apparatus according to claim 1 , wherein said edge processing section selectively sets a pic- 
35 ture element value of each of picture elements of said image as a concerned picture element to that of one of 

neighbor pfcture elements of the pfcture element in units of picture elements of said image, to produce said 
enhanced image. 

3. The image processing apparatus according to daim 2, wherein said edge processing section carries out an 
40 enhancing process to set said picture element value of said concerned picture element to said picture element 

value of a first one of sad neighbor pk:ture elements when said concerned picture element has a middle color 
between said first neighbor picture element and a second one of said neighbor pteture elements in a direction oppo- 
site to a direction of said first neighbor picture element with respect to said concerned picture element. 

45 4. The image processing apparatus according to claim 3, wherein said edge processing section carries out said 
enhancing process to set said picture element value of said concerned picture element to said picture element 
value of said first neighbor picture element, when said concerned pk:ture element has said middle color, and when 
a first color difference between said concerned picture element and said first neighbor picture element is smaller 
than a second color difference between said concerned picture element and said second neighbor picture element, 

so and to set said picture element value of said concerned picture element to said picture element value of said sec- 
ond neighbor picture element, when said concerned picture element has said middle color, and when said first 
color difference is equal to or larger than said second color difference between said concerned picture element and 
said second neighbor picture element. 

55 5. The image processing apparatus according to claim 4, wherein said color difference between said first and second 
neighbor picture elements is the largest among said color differences in the other opposing directions. 

6. The image processing apparatus according to claim 5, wherein said edge processing section carries out said 
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enhancing process, when a color difference between said first and second neighbor picture elements is equal to or 
larger than a first predetermined value. 



7. 



8. 



20 



30 



35 



40 



45 



The image processing apparatus according to claim 5, wherein said edge processing section carries out said 
enhancing process, when a ratio of a third color difference between picture elements outside of said first and sec- 
ond neighbor picture elements in said opposing directions to a third color difference between said firet and second 
neighbor picture elements is equal to or larger than a second predetermined value. 

The image processing apparatus according to any of claims 1 to 7. wherein said region data producing section 
comprises: 

a converting section which converts said RGB data of each of said picture element of said enhanced image 
into density data and hue data; 

a density dividing section which divides said enhanced image Into density regions with respect to said density 
date to output density region data indicative of each of said density regions, density variance data of each of 
said density regions and density contour edge data indicative of a contour of each of said density regions- and 
a hue dividing section which divides said enhanced image into hue regions with respectto said hue data to out- 
put hue region data indicative of each of said hue regions, hue variance data of each of said hue regions and 
hue contour edge data indicative of a contour of each of said hue regions. 

9. The image processing apparatus according to claim 8. wherein said density dividing section comprises: 
a density reducing and quantizing section which quantizes said density data; 

a constant density clustering section which divides said enhanced image into density regions with respect to 
said density data to output said density region data for each of said density regions- 
a density variance detecting section which calculates said density variance data of e^ of said density regions 
to detect density uniformity of each density region; 

a density edge-in-window detecting section which detect steepness of an edge in a window and 
a density edge continuity conflmiing section which confirms continuity of said edge from said density data and 
said detected steepness to produce said density contour edge data to output said density contour edge data. 

10. The image processing apparatus according to claim 9, wherein said density reducing and quantizing section 
rounds lower bits of said density data for the quantization. » ^ a > 

11. The image processing apparatus according to any of claims 8 to 10, wherein said hue dividing section comprises: 
a hue rechjcing and quantizing section which quantizes said hue data; 

a constant hue clustering section which divides said enhanced image into hue regions with respect to said hue 
data to output said hue region data for each of said hue regions; 

a hue variance detecting section which calculates said hue variance data of each of said hue regions to detect 
hue uniformity of each hue region; 

a hue edge-in-window detecting section which detect steepness of an edge in a window and 
a hue edge continuity confirming section which confimtw continuity of said edge from said hue data and said 
detected steepness to produce said hue contour edge data to output said hue contour edge data. 

12. The Image processing apparatus according to daim 1 1 ; wherein said hue reducing and quahtizing section rounds 
lower bits of said hue data for the quantization. " . ^ " w. rounos 

50 Jj3j^^P™^'"9^P*'«*"^«=«»«*'"9toanyofclaims1 to 12, wherein said region determining section com- 



55 



a density region detennining section which detennines objective hue regions among said density regions 
based on density variance data of said variance data and density contour edge data of said contour edge data- 
a hue region detemiining section which detemiines objective density regions based on hue variance data of 
said variance data and hue contour edge data of said contour edge data; and 

an integrating section which integrates said determined objectVe density'regions by said density region deter- 
mining section and said determined objective hue regions by said hue region detemiining section to produce 
said first region. 
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1 4. The image processing apparatus according to dainri 1 3, wherein said integrating section adds first region indication 
data and second region indication data to said first region, 

said region detemnining section further comprises: 
5 an image process region processing section which outputs picture element region indication data from said 

first region indication data and second region indication data in units of picture elements, and 
said image processing apparatus further comprises: 

an image processing section which processes said image based on said picture element region indication data 
from said image process region processing section. 

10 

1 5. The image processing apparatus according to claim 1 4, wherein said region determining section further comprises: 

a coding process region processing section which processes said first region indication data and second 
region indication data in units of block to output block region indication data, and 
15 saki image processing apparatus further comprises: 

a data compressing section whteh compresses said processed image from said image processing section 
based on said block region indication data. 

16. An image processing method comprising: 

20 

enhancing an edge portion of a first region of an image in units of picture elements to produce an enhanced 
image, wherein said image includes said first region and a second region which are mixed, and picture ele- 
ments of said image are expressed to as RGB data; 

dividing said enhanced image into regions to output region data indicative of each of said regions, variance 
25 data of each of said regions and contour edge data indcative of a contour of each of said regions; and 

detemnining said first region in said enhanced image based on said region data, said variance data and said 
contour edge data. 

17. The image processing method accordingto claim 16, wherein said enhancing includes: 

30 

selectively setting a picture element value of each of pk^ture elements of said image as a concerned picture 
element to that of one of neighbor picture elements of the pfcture element in units of picture elements of said 
image, to produce said enhanced image. 

35 18- The image processing method according to claim 17, wherein said enhancing includes: 

carrying out an enhancing process to set said picture element value of said concerned picture element to said 
picture element value of a first one of said neighbor picture elements when said concerned picture element has 
a middle color between said first neighbor picture element and a second one of said neighbor picture elements 
40 in a direction opposite to a direction of said first neighbor picture element with respect to said concerned pic- 

ture element 

19. The image processing method according to claim 18. wherein said enhancing includes: 

45 canying out said enhancing process to set said picture element value of said concerned picture element to 

said picture element value of said first neighbor picture element, when said concerned pkXure element has 
sakJ middle color, and when a first color difference between said concerned picture element and said first 
neighbor picture element is smaller than a second color difference between said concerned picture element 
and said second neighbor picture element, and to set said picture element value of said concerned picture ele- 

50 ment to said picture element value of said second neighbor picture element, when sgJd concerned picture ele- 

ment has said middle color, and when said first color difference is equal to or larger than said second color 
difference between said concerned picture element and said second neighbor picture element 

20. The image processing method according to claim 19, wherein said color difference between said first and second 
55 neighbor picture elements is the largest among said color differences in the other opposing directions. 

21. The image processing method according to daim 20, wherein said enhancing includes: 
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Image pm»ssin9m«,M.0(»«ingloclrtn 20, »!,.»» »M,„t«w„gM^^ 

data to output hue region data LLive of L^nf k ? ° '^S'"*"^ «^P«« ^ ^^^^ ''"s 
..onsan.Huecont?.e.grr?ratra:^^^^^^^ 

24.Thei.ageprocesaingrnethoda«o,.ingtoc,ai.23.whe..nsaW^ 
quantizing said density data* 

detecting steepness of an edge in a window and 

25. The image processing method according to daim 24. wherein said quantizing includes: 

rounding iower bits of said density data for the quantization. 

26. The image processing method accoreling to any of claims 23 to 2S i«ha»in 

atlon Includes: 25. wherein sajd carrying out a first clustering oper- 

quantizing said hue data; 

27. The ™oe l»ic«.h, «c.Min8 to d«m !S, Ma ,^,.,5, 

»<w*ia too 6iB of ssia ho. aaa lor the qusmliMin,. 
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integrating said determined objective density regions by said density region detemnining section and said 
determined objective hue regions by said hue region detemiining section to produce said first region. 

29. The image processing method according to claim 28. wherein said integrating includes: 

adding first region Indication data and second region indication data to said first region, 
said determining said first region further comprises: 

outputting picture element region indication data from said first region indication data and second region indi- 
cation data in units of picture elements, and 
said image processing method further comprises: 

processing said image based on said picture element region Indication data from said image process region 
processing section. 

30. The image processing method according to claim 29, wherein said determining said first region further comprises: 

processing said first region indication data and second region indication data in units of block to output block 

region indication data, and 

said image processing method further comprises: 

compressing said processed image from said image processing section based on said block region indication 
data. 

31. A recording medium in which a program is stored for an image processing method, wherein said method com- 
prises: 

enhancing an edge portion of a first region of an image in units of picture elements to produce an enhanced 
image, wherein said image includes said first region and a second region which are mixed, and picture ele- 
ments of said image are expressed to as RGB data; 

dividing said enhanced image into regions to output region data indicative of each of said regions, variance 
data of each of said regions and contour edge data ind'cative of a contour of each of said regions; and 
determining said first region in said enhanced image based on said region data, said variance data and said 
contour edge data. 

32. The recording medium according to claim 31 , wherein said enhancing includes: 

selectively setting a picture element value of each of picture elements of said image as a concerned picture 
element to that of one of neighbor picture elements of the pk:ture element in units of picture elements of said 
image, to produce said enhanced image. 

33. The recording medium according to claim 32, wherein said enhancing includes: 

canying out an enhancing process to set said picture element value of said concerned picture element to said 
picture element value of a first one of said neighbor picture elements when said concerned picture element has 
a middle color between said first neighbor picture element and a second one of said neighbor picture elements 
in a direction opposite to a direction of said first neighbor picture element with respect to said concerned pic- 
ture element. 

34. The recording medium according to claim 33, wherein said enhancing includes: 

canTing out said enhancing process to set said picture element value of said concerned picture element to 
said picture element value of said first neighbor picture element, when said concerned picture element has 
sakl middle color, and when a first color difference between said concerned picture element and said first 
neighbor picture element is smaller than a second color difference between said concemed picture element 
and said second neighbor picture element, and to set said picture element value of said concerned picture ele- 
ment to said picture element value of said second neighbor picture element, when said concerned picture ele- 
ment has said middle color, and when said first color difference is equal to or larger than said second color 
difference between said concemed picture element and said second neighbor picture element 

35. The recording n^dium according to claim 34, wherein said color difference between said first and second neighbor 
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Pfcture etemente the largest among said color differences In ,he other oppo^ng directions. 

36. The recording medium according to claim 35. wherein said enhancing includes: 

« '^f'^"9°"'^^'''«"*'ancing process, when a color difference between said fir«i=„Hc m • 

elements is equal to or larger than a first predetemiined STe "^'3'"'°' ^""^ 

37. The recording medium according to claim 35. wherein said enhancing includes: 

rTdrrrn?neX%i^^^^^^ 

Je^eensa^^^andseconSnelgh^horpreT^^^^^^^ 

« 38. T^^erecordingmediumaccordingtoany ofclaimsai to 37. wherein said dividing includes: 
courting said RGB data Of each Of saw pteture element Of said enhanced ^na^^ 

s^ni^^rs^^^ 

said density regions and density contour ed™ dtteinl . '^^'^^ °^ each of 

carrying out a second dul^TopSof J s^^^^^^^^ 

data to output hue region datafnSrof lactof h '"^'""^ "^^P^^ ^° hue 

reg.onsandhuecontJuredge^rrd'^tTa"^^^^^^^^^^^ 

39. The recorcnngmedh^m according to c^,m38.whe,einsald carrying outafirstc, 
quantizing said density data* 

detecting steepness of an edge In a window; and 

40. The recording medium according to claim 39. wherein said quantizing Includes: 

rounding lower bits of said density data for the quantlzatioa 

41. The r^^ording medium according to any of Calms 38 to 40. wherein said carrying out a first .ustering ope.tion 

quantizing said hue data- 

iouinliiglowefWlsofsaldl«»aata)i»ii„ quandzMon. 
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data and density contour edge data of said contour edge data; 

determining objective density regions based on hue variance data of said variance data and hue contour edge 
data of said contour edge data; and 

integrating said determined objective density regions by said density region detemnining section and said 
determined objective hue regions by said hue region detemnining section to produce said first region. 

44. The recording medium according to claim 42. wherein said integrating includes: 

adding first region indication data and second region indication data to said first region, 
said determining said first region further comprises: 

outputting picture element region Indication data from said first region Indication data and second region Indi- 
cation data in units of picture elements, and 
said image processing method further comprises: 

processing said image based on said picture element region indication data from said image process region 
processing section. 

45. The recording nr^edium according to claim 44. wherein said determining said first region further comprises: 

processing said first region indication data and second region indication data in units of block to output block 

region indication data, and 

said image processing method further comprises: 

compressing said processed image from said image processing section based on said block region indteation 
data. 
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